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Given a network and a partition in communities, we consider the issues "how communities in- 
fluence each other" and "when two given communities do communicate". SpecificaUy, we address 
these questions in the context of small-world networks, where an arbitrary quenched graph is given 
and long range connections are randomly added. We prove that, among the communities, a su- 
perposition principle applies and gives rise to a natural generalization of the effective field theory 
already presented in [Phys. Rev. E 78, 031102] (n = 1), which here (n > 1) consists in a sort of 
effective TAP (Thouless, Anderson and Palmer) equations in which each community plays the role 
of a microscopic spin. The relative susceptibilities derived from these equations calculated at finite 
or zero temperature, where the method provides an effective percolation theory, give us the answers 
to the above issues. Unlike the case n = 1, asymmetries among the communities may lead, via 
the TAP-like structure of the equations, to many metastable states whose number, in the case of 
negative short-cuts among the communities, may grow exponentially fast with n. As examples we 
consider the n Viana-Bray communities model and the n one- dimensional small-world communities 
model. Despite being the simplest ones, the relevance of these models in network theory, as e.g. 
in social networks, is crucial and no analytic solution were known until now. Connections between 
percolation and the fractal dimension of a network are also discussed. Finally, as an inverse prob- 
lem, we show how, from the relative susceptibilities, a natural and efficient method to detect the 
community structure of a generic network arises. 

For a short presentation of the main result see l arXiv:0812. 06081 
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I. INTRODUCTION 



In the last decade we have seen an impressive grovifth 
of the network's science and of its broad range of appli- 
cations in fields as diverse as physics, biology, economy, 
sociology, neuroscience, etc... P, 12, S S, Hi ■ Many analyt- 
ical and numerical methods to investigate the statistical 
properties of networks, such as degree distribution, clus- 
tering coefRcient, percolation, and critical phenomena at 
finite temperature, as well as dynamical processes, are 
nowadays available (see @ and references therein). In 
particular, in recent times, the issue to find the "opti- 
mal" community's structure that should be present in a 
given random graph (a network) (£,r), C and F being 
the set of the vertices and of the bonds, respectively, has 
received much attention. The general idea behind the 
community's structure of a given network comes from 
the observation that in many situations real data shows 
an intrinsic partition of the vertices of the graph in n 
groups, called communities, C — Wl^^C^^\ such that be- 
tween any two communities there is a number of bonds 
that is relatively small if compared with the number of 
bonds present in each community. If we indicate by F'^'''^^ 
the set ob bonds connecting the /-th and the fc-th commu- 
nities, we can formally express the above idea by using 
the decomposition F = U"<j.^]^F'^'''^\ and the inequal- 
ity IF^'''^)! < |F(')|, IF^*^)], for I ^ k. The partition(s) 
can be used to build a higher-level meta-network where 
the meta-nodes are now the communities (cells, proteins, 
groups of people, . . .) and play important roles in un- 



veiling the functional organization inside the network. 
In order to detect the community's structure of a given 
network, many methods have been proposed and special 
progresses have been made by mapping the problem for 
identifying community structures to optimization prob- 
lems 0, 13, IHIj [S [3j by looking for fc— clique 
sub-graphs [14 1, or by looking for clustering desynchro- 
nization [l5| and, very recently, by using random walks 
[T^ . In general there is not a unique criterion to find 
the community's structure [l3l- However, once obtained 
some structure, whatsoever the method used, and assum- 
ing that the found partition (Uj'^i-C^'^, UJ"<j.^;^F('''=)) rep- 
resents sufficiently well the intrinsic community's struc- 
ture of the given network [l^ , there is still left the fun- 
damental issue about the true relationships among these 
communities. Under which conditions, and how much 
two given communities communicate, how they influence 
each other, positively or negatively, what is the typical 
state of a single community, what is the expected be- 
havior for n large, etc... are all issues that cannot be 
addressed by simply using the above methods to detect 
the community structure. In fact, all these methods, 
with the exception of Refs. 0, [l^, and [l^, are es- 
sentially based only on some topological analysis of the 
network, and in most cases, only local topological prop- 
erties are taken into account. The way to uncover the 
real communication among the communities is to pose 
over the graph {C, F) a minimal model in which the ver- 
tices assume at least two states, i.e., as the spins in an 
Ising model. Confining the problem to the equilibrium 
case we have hence to use the Gibbs-Boltzmann statisti- 
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cal mechanics and find the relative susceptibihties x^''*'-' 
among the communities of a suitable Ising model. In this 
approach the temperature T can be seen as a parameter 
describing the freedom of the vertices to assume a state 
independently of the state of the other vertices, while the 

(I k) 

coupling J- J between two vertices i and j belonging to 
the Z-th and fc-th community, respectively, as a tendency 
of the vertices to be positively or negatively correlated, 
according to the amplitude and to the sign of Ji'^f ^- 

We point out that, given a community structure, our 
main aim is to calculate the magnetizations to'-'-' and the 
relative susceptibilities x^^''^'' of the communities, while 
Refs. 0], and [IB], treat the quite different prob- 
lem of detecting the community structure by looking for 
the partition of the graph that, among the communities, 
minimizes the correlations, the synchronization, or the 
diffusion, respectively. Although this is a natural and in- 
teresting way for defining a community structure, and to 
which we devote a study in this paper too and find some 
connections with [l6j . in many situations the obtained 
partition does not correspond to the intrinsic partition 
of the graph (H^l . 

At least in principle, if a Gibbs-Boltzmann exp{—f3H) 
distribution with some Hamiltonian H has been assumed, 
one can obtain pjf'^'^ from the data of the given graph 
by isolating the two vertices «,j from all vertices of the 
graph other then them, and by measuring the correlation 
function of the obtained isolated dimer [uicrj)', where (•)' 
stands for the Gibbs-Boltzmann average of the isolated 
dimer ^51j . The general problem is actually more compli- 
cated due to the presence of two sources of disorder since 
both the set of the bonds F, and the single couplings 
{•^i j-'^^Ij may change with time. Assuming that the time 
scale over which these changes take place is much larger 
than that of the thermal vibrations of the spins, we have 
then to facing a disordered Ising model with quenched 
disorder. 

In this paper we specialize this general problem to 
the case of Poissonian disorder of the graph, while 
we leave the disorder of the couplings arbitrary. We 
formulate the problem in terms of Ising models on 
generic small- world graphs [Toj : given an arbitrary graph 
(£o,ro), the pure graph, and a community's structure 
(U[L;^£q \ U"<-j,^;^rQ '''^), in which each community has 
an arbitrary size, we consider a generic Ising Hamilto- 
nian defined on this non random (quenched) struc- 
ture, the pure model, characterized by arbitrary couplings 
Jq'^\ and we add some random connections (short-cuts) 
with average connectivities along which a random 

coupHng jC''^) takes place, and study the corresponding 
random Ising model, the random model, having therefore 
a random Hamiltonian H . 

In [2^ we established a new general method to ana- 
lyze critical phenomena on small-world models: we found 
an effective field theory that generalizes the Curie- Weiss 



mean-field theory via the equation 

m(^) -TOo(/3jf\/3j(^)m(^)), (1) 

and that is able to take into account both the infinite 
and finite dimensionality simultaneously present in small- 
world models. In Eq. ([1]), mo{(3Jo', f3h) represents the 
magnetization of the pure model, i.e., without short- 
cuts, supposed known as a function of the short-range 
coupling Jo and arbitrary external field h, whereas the 
symbol S stands for the ferro-like solution, S = F, or 
the spin glass-like solution, 12 = SG, and Jg^"* and J^^' 
are effective couplings. Here we generalize this result to 
the present case of n communities of arbitrary sizes and 
interactions; short-range and long-range (or short-cuts) 
couplings. We show that, among the communities, a nat- 
ural superposition principle applies and we find that the 
n order parameters, F or SG like, obey a system of equa- 
tions which, a part from the absence of the Onsager's 
reaction term [2l|, can be seen as an n x n effective sys- 
tem of TAP (Thouless, Anderson and Palmer) equations 
22] in which each community plays the role of a single 
"microscopic" -spin mP-'''^\ I = l,...,n and, depending 
on the sign of the couplings, behave as spins immersed 
in a ferro or glassy material. 

As for one single community, our method is exact in the 
paramagnetic region (P) (more precisely is exact in the 
region where any order parameter is zero) and provides 
an effective approximation in the other regions, becom- 
ing exact for unfrustrated disorders even off the P region 
in the limits c^'''''^ — > 0+ and c^'-'^^ — > 00. In the Ref. 
[20I 1 (n = 1) we established the general scenario of the 
critical behavior coming from these equations, stressing 
the differences between the cases Jo>Q and Jo < 0, the 
former being able to give only second-order phase transi- 
tions with classical critical exponents, whereas the latter 
being able to give rise, for a sufficiently large connectivity 
c, to multicritical points with also first-order phase tran- 
sitions. The same scenario essentially takes place also for 
n > 2 provided that the Jo's and the J's be almost the 
same for all the communities (and in fact in this case, i.e., 
near the homogeneous case, the partition in n communi- 
ties does not turn out to be very meaningful and taking 
n = 1 would lead to almost the same result), otherwise 
many other situations are possible. In particular, unlike 
the case n = 1, relative antiferromagnetism between two 
communities I and k is possible as soon as the jC-'^) have 
negative averages, while internal antiferromagnetism in- 
side a single community, say the Z-th one, due to the 
presence of negative couplings Jq'"* < 0, is never possible 
as soon as disorder is present. Less intuitive and quite 
interestingly, if we try to connect randomly with some 
added connectivity c*-''*''^ the Z-th community having in- 
side only positive couplings ( "good" ) to the fc-th commu- 
nity having inside only negative couphngs ("bad"), not 
only the bad community gains a non zero order, but even 
the already good community gets an improved order. 

However, with respect to the case n = 1, another pecu- 
liar feature to take into account is the presence of many 
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metastable states. In fact, this is a general feature of 
the TAP-hke structure of the equations: as we consider 
systems with an increasing number of communities, the 
number of metastable states grows with n and may grow 
exponentially fast in the case of negative short-cuts. A 
metastable state can be made virtually stable (or, more 
precisely leading) by forcing the system with appropri- 
ate initial conditions, by fast cooling, or by means of 
suitable external fields. As a result, with respect to vari- 
ations of the several parameters of the model (couplings, 
connectivities, sizes of the communities), the presence 
of metastable states may lead itself to first-order phase 
transitions even when the Jq are all non negative. This 
general mechanism has been already studied in the sim- 
plest version of these models, namely the n — 2 Curie- 
Weiss model (Jo = and c'^'^^ = oo), where a first-order 
phase transition was observed to be tuned by the rela- 
tive sizes of the two communities and by the external 
fields (23|; moreover, first-order phase transitions have 
been observed in numerical simulations of a two dimen- 
sional small- world model with directed shortcuts [13] [13] ■ 
In particular, in system of many communities, n 3> 1, 
a remarkable and natural presence of first-order phase 
transitions (tuned by the several parameters) is expected 
which, if the J's or the Jo's are negative, reflects on the 
fact that the communities, at sufficiently low tempera- 
ture, behave as spins in an effective glassy state [25, 26]. 

Finally, we show that the theory can be projected at 
zero temperature where a natural effective percolation 
theory arises. Then, in this limit, a quantity of remark- 
able importance, the relative susceptibility among the 
communities, is provided and we will show that, by start- 
ing from the data of the network, it can be efhciently sam- 
pled via simulated annealing procedures. Such a quantity 
in fact tells us in a not ambiguous manner whether two 
given communities / and k do communicate or not, and 
what is their characteristic time t'-''^-' to exchange a unit 
of information. It will result clear that, given the pure 
graph, unlike a local analysis (based therefore only an 
elementary use of the adjacency matrix) might say, the 
presence of some bonds Tq between the two commu- 
nities, does not guarantees that they communicate, i.e., 

(I k) 

that be ' < oo. More in general, it will become clear 
that even a minimal model such as the one we introduce, 
due to the fact that it incorporates exactly all the corre- 
lations, short- and long-range like, can give rise to situa- 
tions which drastically differ from methods in which only 
a local analysis of the bonds is taken into account and/or 
correlations (including their signs) are never introduced. 

As mentioned before, as a byproduct, we show also 
that, in particular, the percolation theory provides itself 
another natural way to detect community's structures. 
More precisely, similarly to what done in [l6| , we can de- 
fine a family of generalized modularity functions Q able 
to probe the community structure of the given network, 
pure or random, at several length scales. We will see that 
the algorithm of this method turns out to be statistically 
efficient in the limit of small and infinite length scales. 



In this paper, as first analytical applications of the 
method, we consider two important class of models: the 
generalized Viana-Bray (VB) model [13] and its special 
limits of infinite connectivity, i.e., the generalized Curie- 
Weiss (CW) and the generalized Sherrington-Kirkpatrick 
(SK) models [1^; and the generalized one-dimensional 
small-world models for n communities. A complete anal- 
ysis of these two class of models is beyond the aim of 
this paper since a deeper study, also equipped with some 
numerical analysis of the self-consistent equations and, 
more in general, of the minima of the associated Lan- 
dau free energy density, would be required. We point 
out however that our results are completely novel. No- 
tice in fact that, without any intention to be exhaustive 
in citing the large literature on the subject, the state of 
the art of analytical methods for disordered Ising models 
defined over Poissonian small- world graphs results nowa- 
days as follows: i) in the case of no short-range cou- 
plings, Jo = 0, and for one community, n = 1, modulo a 
large use of some population dynamics algorithm for low 
temperatures, the replica method and the cavity method 
[25I . [29I . [30l . [3l| have established the base to solve exactly 
the model in any region of the phase diagram, even rig- 
orously in the SK case [H, HI] and in unfrustrated cases 
(3^ : ii) for Jo 7^ and n = 1 these methods have been 
successfully applied to the one-dimensional case [s^, [s^ 
but a generalization to higher dimensions (except infinite 
dimensions [13]) seems impossible due to the presence of 
loops of any length [ssl]; on the other hand, even if it 
is exact only in the P region, the method we have pre- 
sented in the Ref. pOj, modulo solving analytically or 
numerically a non random Ising model, can be exactly 
applied in any dimension, and more in general to any un- 
derlying pure graph (£oiro); for Jo = and n > 2, 
the problem was solved only in the limit of infinite con- 
nectivity: exactly in the n — 2 CW case in its general 
form, which includes arbitrary sizes of the two commu- 
nities, but with no coupling disorder [2^; and, within 
the replica-symmetric solution, in the generic n SK case, 
but only in the presence of a same mutual interaction 
among the n communities of same size [38L [39| . Out of 
this range of models, no method was known to face an- 
alytically the general problem with finite connectivities, 
in arbitrary dimension do, and with a general disorder, 
despite its relevance in network theory, as e.g., in social 
networks [H^]. 

The paper is organized as follows. In Sec. II we intro- 
duce the small- world communities network over which we 
define the random Ising models. In Sec. Ill we present 
the result: in Sec. IIIA we provide the self-consistent 
equations, the correlation functions, the Landau free en- 
ergy density and the relative susceptibilities; in Sec. IIIB 
we analyze the phase transition scenario; in Sec. IIIC we 
discuss the level of accuracy of the method. In Sec. IV 
we apply the method to the above mentioned example 
cases (CW, SK, VB and one dimensional models). In Sec. 
V we consider the theory at zero temperature obtain- 
ing the percolation theory and the characteristic times of 
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communication among communities. In this section, as 
byproducts, we show an interesting connection with the 
concept of fractal dimension and how to detect a com- 
munity structure within our framework. Sees. VI an 
VII are devoted to the proof. FinaUy in Sec. VIII some 
conclusions are drawn. 

A short presentation of this work can be found in 
larXrv:0812.0608. 



^YiQ ly^Q directed average connectivities of the graph 
(.(^k) counting how many bonds, in the average, connect 
a given vertex of £q ^ with vertices of £q'^' , and vice- versa, 
respectively. Due to their definition, for I ^ k, c*^''*^^ and 
^{k,i) g^j-g j-^qi- independent, in fact it must hold the fol- 
lowing balance equation 

N(i)^ii,k) ^^ik)^ik,i)^ (6) 



II. RANDOM ISING MODELS ON 
SMALL- WORLD COMMUNITIES 



or else, by using ^ 



(7) 



Let be given n distinct graphs {Cq\Tq^), I — 1 



Cq^ and Tq' being the set of vertices and bonds of the l- 
th graph, respectively [11] . Elements of a set of vertices 

>Cg^ will be indicated with Latin index i or j, whereas 

elements of a set of bonds Fq ■* will be indicated as couples 

Let the size of Cq ^ be 

= A^C) =a«Ar, (2) 

where the a^'^ 's are n non negative numbers such that (56j 



.(0 



1. 



(3) 



Moreover, let be given other n{n — l)/2 distinct graphs 
(£q Fq''^-'), I < fc, with l,k — l,...,n, where 
£{i,k) de/ ^(;) ^ ^{k) ^j^^ sum-set of the vertices of £n ' 



and /Iq*^' , and Fq 

some vertices of with some vertices of C^I^K 

Given, for each community, an Ising model - shortly 
the pure model of the community with Haniiltonian 



(i,fe) 



an arbitrary set of bonds connecting 



^(0 dg _ 



E 

(»,j)er<" 



t(0 



(0 



let be 



i7o^=^E^^'-E E 



j{i,k) 



J' 



(4) 



(5) 



t(0 



where the h'^^^ are arbitrary external fields and Jo.(i 

and the Jq.'^^j^'s are arbitrary "short-range" couphngs. 
From now on, for shortness, we will use for them the 
simpler notations Jq^'s and the Jq'''\ respectively, as if 
they were uniform couplings. However, it should be kept 
in mind that there is no limitation in the choices of these 
couphngs, as well as in the choice of the graphs (£o\ Fg ') 
and (4''^\f[,'''-)). 

Let be given n+n{n — l)/2 independent random graphs 
c^'''^^ I < k — 1, . . . ,n. We will indicate by c^'''^ the aver- 
age connectivity of the graph c*^''') (average with respect 
to a measure P{c) we soon prescribe), and by c*^''*''-' and 



Eq. ([7]) suggests to define the following symmetric matrix 
which we will soon use: 



(8) 



Besides the constrains (O, it is important to recall that, 
for finite A^, the connectivities are bounded as follows 



< c^'''^) < a^'^^N, 
or else, by using the symmetric matrix 
< c('''^-) < aWa^'^^A^. 



(9) 



(10) 



We will use the symbol cf^'^'' to indicate the adja- 

,(i,fc)- ^(''''') 

i e -Cq^j e 'Cq'^'. The symbol c will indicate the graph 
obtained as union of all the n + n{n — l)/2 graphs c^^'^\ 
I <,k = 1, . . . ,n. 

We now define our small- world models. For each I 
we super-impose the bonds of the random graph c^'''-* 
to connect, through certain short-cuts, some vertices of 
Cq \ and for each couple (/, k) we super-impose the bonds 
of the random graph c*^'"'^-' to connect, through certain 
short-cuts, some vertices of Cq^ with some vertices of 

>Cq •* , and define the corresponding small- world model on 
the n communities - shortly the random model - as de- 
scribed by the following Hamiltonian 



cency matrix elements of the graph c^''''-': c)')'"' = 0,1, 



def 



^-E E 



E E 4''Jir-^-.^ 



the free energy F and the averages (O)', with ^ = 1,2, 
being defined in the usual (quenched) way as 

- /3F "if ^('^) / ('^) (^-;-^) ' (12) 



and 



{OY ^(^) / '^^ ('^) ^0)\ ; = 1, 2 (13) 
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where Z^ j is the partition function of the quenched sys- 
tem 



Za,J - 



-f}H^.,j{{^,}}) 



(14) 



{0)c:j the Boltzmann-average of the quenched system 
(note that {0)c;j depends on the given reahzation of the 
J's and of c: (O) = {0)c:j\ for shortness we wiU often 
omit to write these dependencies) 



dej Sjq,} Qc;J ' 



-PH^,j({a,}) 



(15) 



and dV (J) and P{c) are two product measures given 
in terms of n + n(n — l)/2 normaUzed measures, 

d^^^'^\jf'^^) > and other n + n{n — l)/2 normahzed 
p^'-'^) (^cff^) > 0, respectively: 



measures 



dvij) n n v'^'^i-^s')' 
n n d.i^^'^' (j^f^) 



) = 1, 



(16) 



Notice that the matrix entering Eq. (jlSp is the symmetric 
one and not c^'-'^\ however, in the thermodynamic hmit 
N ^ oo, for each (l,k), the degree random variables 



de_f (i,fc) (/) 



(20) 



will be distributed according to a Poissonian law with 
the directed average connectivity c^'^*^^. 

Concerning the measures d/i^'''^^ they are completely 
arbitrary. When necessary, to be more specific in consid- 
ering some example, we shall assume one of the following 
typical measures 



fe) 



dJ, 



(i,k) 



(l.k) 

j 



j(Lk) 



(21) 



^4.(4f^-j('^^))+i.(^^'+j('^^))(22) 



dJ. 



{i,k) 



N 



27rj('''=) 



exp 



N 



2J('.'=) 



-N 



(23) 



^(-)(cg') 



p{c) n n ^'''(^ 

' i<j, ije4" 

X n n ^^'^^fi 



(17) 



where the parameters jC^*^) (not to be confused with the 
random variables jff^) are arbitrary, and jC^'^) > 0. 



III. AN EFFECTIVE FIELD THEORY 



A. The self-consistent equations for n communities 



The variables cff'' G {0, 1} specify whether a "long- 



range" bond between the sites i G -Cg •* and j e c\^'' 



is present {c^lf' = 1) or absent {c"^'^^' = 0), whereas the 
jf'^'^ 's are the random couplings of the given bond (i, j). 
For I ^ k, the probability p^''*^) to select a bond connect- 
ing £-Q ^ with £,Q among all the possible AtW^v^'^) bonds 
is given by p^'''^^ — c^^^^^ / [Na^^") a^^^). Therefore the ran- 
dom variables cff^ 's obey the following distributions 



(5 (i,fc) , 

c)^- ,1 



1 - 



(5 



(18) 



which, for I = k reduces to 



(ID c^-^ f c('^') 

) = TWO '^c<V",i + ( 1 - ]^ ) '5.<'.'".n- (19) 



Physically, depending on the temperature T, and on 
the parameters of the probability distributions {d/i^'^*^)} 
and the connectivities {c'''^}, the random model may sta- 
bly stay either in the phases P, F, SG, or AF. However, as 
we have already showed in the Ref . [20[ , in our approach 
for any choice of T, d^ and c, independently of the signs 
of the couplings and on the fact that the corresponding 
order parameters are zero or not, for the free energy, and 
then for any observable, there are always two - and only 
two - stable solutions that we label as F and SG and 
that in the thermodynamic limit only one of the two sur- 
vives. Therefore, an AF like phase in our approach is 
not represented by another solution; an AF like phase, if 
any, occurs in the solution with label F. In the Ref. [23| 
we showed that, for n = 1, for the solution with label F 
and SG there are two natural decoupled order parameters 
that we have indicated as to^^^ and m^^^^ respectively. 
Similarly, now we have n coupled order parameters rrS^''^^ 
for the solution F and n other coupled order parameters 
jji(SG;i) for the solution SG, I — 1, . . . ,n. All the results 
we provide are exact up to 0(1 /iV) corrections. 
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1. Jt^''*"' =Oforl^k 

Let us consider the interesting case in which there are 
no short-range interactions between different communi- 
ties, i.e., let us assume that Jq''^^ = for Z 7^ fc. Let 

TOq (/? Jq'^ ; /3ft.'-'-' ) be the stable magnetization of the pure 
model with Hamiltonian Then, for both E =F and 
SG, the n order parameters m*^^'') satisfy independently 
the following system of n coupled equations 

= m« [pjp'^ ; (^^') Ph^'^ ) , (24) 

where 

k 

and the effective couphngs j(SG;;,fc)^ ^o^''^ and 

Jq are given by 

^j(F;/,fc) rfj/ |rf^('^fe)(j(^:'=))tanh(/3j(f)), (26) 
^j(SG;/,fc)rfj/^(i,/c) I rf^('.fc)(jg'=))tanh2(/3jg'=)), (27) 

(28) 

and 

G:') 11/ tanh-i(tanh2(/3J^")). (29) 

Note that, when a^'^ ^ a'*'-' , unlike the random couplings 
Ji''f \ the effective couplings and j(SG;','=) are 

not symmetric. However, as we shall see soon, the cou- 
plings entering the free energy are the symmetric ones: 
Note also that |jf ''^| > 4^"^''^. 

For a correlation function Cr of degree r, involving 
a set of r vertices belonging only to the same community 
£o ^ we have 

= (/3 Jf (^^') -h /3ft« ) , (30) 
I 



whereas for a correlation function Cr,s ' of degree r + s, 
involving a set of r vertices belonging to £q ^ and a set 
of s vertices belonging to £g'^^ , with I ^ k, we have 

X c('=)(/3jf^'^^/3i7(^^^-)+/3ftW), (31) 

where the C^t)(/3J^'^ /3ft('))'s are the corresponding cor- 
relation functions of degree r of the pure model with 
Hamiltonian (|4|). For the specific relation between the 
above correlation functions and the averages or quadratic 
averages of physical observables, we remind the reader to 
Eqs. (24)-(28) of the Ref. [20i]. In particular in the F 
phase we have 

^ = m(P^'), (32) 

from which, by using ^ and ([3]), it follows also that the 
average magnetization m'^-* is given by [57| 

rn(F) =^a(0^(F;0, (33) 

similarly in the SG phase we have 

= zG£«, (34) 



m(SG)2^^a(0^(SG;02_ (35) 
I 

The free energy density /^^^ coming from Eq. (fT2|) 
involves a generalized Landau free energy density L*-^' 
from which it differs only for trivial terms independent 
from the m'^^^'s. The complete expression for /'^^ in 
terms of i'^^ is left to the reader and corresponds to the 
obvious generalization of Eq. (21) of the Ref. 20]. The 
term L^^^ reads (/3/^^^ = trivial term +L'-^'> with 
Z(^) = 1,2 for E =F, SG, respectively) 



L(^)(m(^^i),...,m(^^")) =^a«/3g(^^'), (36) 

where 

^gim '^g !I^pH^m+pfi^)^pj(l).pH(^-'^^+ph(% (37) 

f^^\p4^\ PhMy) being the free energy density in the thermodynamic limit of the pure model with Hamiltonian Q. 
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Eq. (j36p can be also expressed in a more symmetric way as 



. , m 



(E;n; 



Lk 



^(0^j(S;i,fc)^(S;0^(E;fe) 



2. 3(/, fc), mt/i / / k, such that J^''*"^ / 

Here we consider the most general case in which there are at least two communities that interact also via short-range 
couplings. Now the additivity of the free energy of the pure model with respect to the communities is completely lost 
and for any I we need to consider in general mQ\{pjQ •*}; {/3/i(' ^}), the stable magnetization of the l-th community 
of the pure model with the total Hamiltonian ([5]) having, in general, n + n{n — l)/2 short-range couplings {(3Jq ■*} 
and n external fields {/^ft-*-' •*} (we use the parenthesis {•} as a short notation to indicate a vector or a matrix with 



(1,1) de_f (I) 



components I' — 1, ... ,n or l',k' = 1, ... ,71, respectively), where we have also introduced Jq 
order parameters m(^''\ for both E =F and SG, satisfy the following system of n coupled equations 



J' '. Then, the 



(39) 



where the effective fields and the effective couplings are defined as in Eqs. 



alization for Jq^''"'^''). 



(with the obvious gener- 



For a correlation function Cr of degree r, involving a set of r vertices belonging to the same l-th community we 
have again the obvious generalization of ([50]) , while the obvious generalization of Eq. ([?T|) can hold only between two 



groups of communities, say with index I and k, having no short-range couplings: Jq 
course still hold, while the term L*^^^ now becomes 

(0^j(S;i,fc)^(S;0^(S;fe) 



(Lk) _ 



0. Eqs. 



and §^ of 



0fo{{04'^'''};{f3H^''''^+(3h^^'^}), (40) 



/o ^|/5Jo' j" : l/Sft^*-' being the free energy density in the thermodynamic limit of the pure model with the total 

Hamiltonian When J^''''"'' ^ for any I ^ k, Eqs. ^ and (gOl) reduce to Eqs. ^ and jSHl), respectively. 
For given /3, among all the possible solutions of the self-consistent system ([M)) - (P5|) (or (HH])), whose set we indicate 



by tVJ, in the thermodynamic limit, for both E=F and S=SG, the true solution 
solution, is the one that minimizes L^^-*: 



m 



, m 



(S;n)^ 



or leading 



m 



(S;l) 



(S;n) 



min L^^'' ( r 

...,m(S;"))GA^ ^ 



, m 



(S;n) 



(41) 



For the localization and the reciprocal stability be- 
tween the F and the SG phases see the discussion in Sec. 
IHD. 

As an immediate consequence of the Eq. ((39|) we 
get that the adimensional susceptibility of the ran- 
dom model, dm'-^'^^ /d{[3h^'^^), written in matrix 
form is 



• Xo, 



(42) 



where we have introduced the matrix of the effective long- 
range couplings /3J(^''''=), and Xo'''^ {p Jq^ \ Ph^^^) . the 
adimensional susceptibility of the Z-th pure community 
with respect to the external field h'^^^ of the fc-th com- 



munity: 



Al,k) def 
AO — 



(43) 



Note that in the case J, 



(i.k) 



for I 7^ k, Xo^^ is a 



diagonal matrix whereas X^^^ not- 

Remark 1. Note that, as it will become clear by 
looking at the proof in Sec. VH, unlike the case n — 1, 
for n > 2 the expression of L^^' in Eqs. or (^0]) 

has a physical meaning only when calculated at any 
stable solution of the self-consistent system (1^^ or (|39p . 
respectively. In fact, for n > 2, the free energy term L^^^ 
is different from the original density functional of the 
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model that lives in an enlarged space of the order 
parameters; the form of C'^'^^ is equal to the form of L^^-* 
only when calculated in a solution of the self-consistent 
system of Eqs. (155)) or ([^0]) . In this sense, for n > 2, the 
expression "Landau free energy density" for L^^^ would 
be somehow inappropriate; the true Landau free energy 
density is represented by Z!*^^-' and is given in Sec. VII, 
but unfortunately its general expression turns out to be 
too complicated to be exploited for calculating rigorously 
the stability of a given solution. We shall come back 
soon on this point in the next Section. We stress however 
that Eqs. or (|40p cover all the solutions, stable or 

not; in other words at any saddle point (see Sec. VII) of 
the original density functional vC*^^-* we have L*^^^ = 



B. Stability and phase transition's scenario 

Note that, for /3 sufficiently small (see later) and 
{/iW} ^ 0, Eqs. dm) or ([39]) have always the solution 

_ Q ^^^^ furthermore, if Ito^''-*! is a solution 

for {/i^'^} = 0, |to^''''| — |m^''^| is a solution as 

well. From now on, if not explicitly said, we will refer 
only to one of the dual solutions. Equations ((24| or pQ]) 
define a n dimensional map. Under this map a solution 
{to(^'') } of Eq. (1211) or (1211) is stable (but in general not 
unique) if 

|A,|<1, ; = 71 (44) 

where {A;} are the eigenvalues of the n x n 
matrix Xq^^ • /3J^^^ calculated at zero field: 
^(S;/)^0, l = l,...,n. 

Remark 2. Given a solution of the self-consistent 
system ([Ml) or Eq. (gH) represents the stabil- 

ity condition of the solution under iteration as an 
n-dimensional map. As we have mentioned in Remark 
1, due to the fact that, for n > 2, the original density 
functional of the model and the term L*^^^ are 

different, we cannot calculate the true Hessian of 
£<-^^ from the Hessian of L^'^\ Unfortunately, the 
Hessian of >C'^-' has a quite complicated form even when 
calculated at a solution of the self-consistent system 
([Ml or ([51)) . The positivity of this Hessian would 
be important to discriminate rigorously the stability 
of any solution. In this sense, as done for n = 1 in 
the Ref. [lO], when the transition is of second-order, 
important information about the critical behavior of the 
system could be obtained by expanding around 
the solution {m^^''^} = by keeping a sufficiently 
large number of terms involving the even derivatives of 
the matrix A^^' (|/3J^''''^| ; {/3H(^'') -I- with 

respect to the external fields I3h^''^ and calculated at 
^ = 0. Such a general study is 



beyond the aim of this paper. Note however that, even 
if we are not able to discriminate rigorously between 
stable and unstable states, due to the fact that the 
self-consistent system ([M)) or ([51)) give all the possible 
solutions, for any given /? we are able to predict exactly 
which is the leading (and then also stable) solution 
by looking at the solution that gives the absolute 
minimum of L(^\ even when there are first-order phase 
transitions [ssj . 

By setting {/i^)} = and expanding Eq. ^ or ^ 
to the first order, we get the equation for the critical 
temperature 1 / Pc of a P-S phase transition when it is 
of second-order: 

max |Az| = 1, (45) 

/— l,...,n 

which implies 

det(A(^)({/3f)jr''=^};{0}))=0, (46) 
where the n x n matrix A^^^ is given by 

=^-xf^-/3j(^)L<.:o.o, .=i,...,„. (47) 

Eqs. (gSl) or (gH) generalize Eq. (44) of the Ref. ^ 
to which reduce for n = 1. In the Ref. ^20| we have 
seen that: when Jq > (and then Jq ' > 0), indepen- 
dently of the added connectivity c and independently of 
the sign of the shortcuts J's (and then independently of 
the sign of J*-^-*), the phase transition, both P-F or P- 
SG, is second-order and the critical indices are the classic 
ones; while, when Jo < 0, we still have Jq > an then 
the P-SG transition is still second-order but, due to the 
fact that now Jq < 0, for a sufficiently large c, there 
are multicritical points and, moreover, it may appear P-F 
first-order phase transitions and in such a case the criti- 
cal temperature in general does not satisfy Eq. ([iS)) and 
the critical behavior can belong to the so called to' the- 
ory of Landau phase transitions, I being an even integer 
greater or equal to 6. However, when n > 2, the above 
"simpler" dual scenario for Jo > and Jo < is in gen- 
eral no more valid. In fact, if for n = 1 in Eq. (gH) we 
set /3J(^) < 0, we see that the solution to*^^^ = is al- 
ways stable (recall that the susceptibility is always non 
negative), while, if - for n > 2 - for some couple (/,fc) 
with I ^ k/vcL Eq. we set /3j(^''''=) < 0, we see that 
in general the solution {m^^^'-'} = is no more a stable 

solution, even if Jq'''"* > and Jq''''"' = for any I ^ k 
(try for example the simplest case: n — 2, 
and j(^'i'i) = J(S;2,2) ^ q). This eflFect is of course at 
the base of antiferromagnetism and gives a clue on how 
much more complex will be now the scenario of phase 
transitions, be P-F or P-SG like. 

According to the symmetries of the effective couplings, 
we distinguish three cases: the homogeneous case, the 
symmetric case and the general case. 
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1. The homogeneous case and the absence of internal 
antiferromagnetism 

Let US consider the uniform case, i.e., the case in which 
the n communities have: equal size, a*-'^ = 1/n, equal 
connectivity, c^'''^^ = c, and interact through: arbitrary 
short-range couplings, {Jq'''^}, but through equally dis- 
tributed long-range couplings, d^'^'"'^^ = c?/^ also for I = k. 

I 



where we have used the definitions and we have 

taken into account that the total average connectivity ct 
seen by each community is Ct = cn. Our general so- 
lution, Eq. ([55]) . reproduces - of course - this result, 
but it is interesting to observe that this effect can be 
seen as due a particular case of the super-position princi- 
ple that emerges in our self-consistent equations for the 
general problem. Note that in this special case, despite 
the existence of n communities, for each phase F or SG, 
there is just one order parameter m*-^^. This fact im- 
plies serious limitations on the possible phases of such a 
model. In fact, let us consider for simplicity the case in 
which all the communities have the same internal short- 
range coupling Jq''''' = Jo and suppose also that there 
is no short-range coupling among different communities: 
J^^'^^ = for ; 7^ fc. From Eqs. (|lSl)-(ISni)we see that for 
^ {0}, and independently of Jo, if J^^^ > 0, aU 
the m'^''^ are parallel (recall that, for ^ 0, at equi- 
librium the sign of the thermal average magnetization of 

the single /-th community, rriQ (/3Jo; is equal to the 
sign of h). If instead J^^^ < 0, at any temperature the 
only stable solution of Eq. is m*^^^ = 0, and since 

the communities do not interact (from the point of view 
of our effective field theory), from Eq. (|48p it also fol- 
lows that {m^^''^} — {0}. More in general, this result 
holds essentially also when we allow for the presence of a 
same short-range coupling among different communities, 
say: Jq'"'^'' = Jo^'^\ for I ^ k. In fact in this case we 
have that for {/i^)} = {0}, ff J^^'^^ > and ff J^'") > 0, 
all the to'^''^ tend to be parallel and equal to the - sin- 
gle - order parameter mS^^] whereas, if j'^^ < 0, at any 
temperature the only stable solution of Eq. is again 



Therefore, these models have only one effective long- 
range coupling, say (3J^^\ and only one order param- 
eter, say m^^' , and reduce to the small- world models of 
one community already studied in the Ref. [1^ whose 
self-consistent equation, in its most general form to in- 
clude n arbitrary external fields, was given by (from Eqs. 
(A7)-(A12) of the Ref. [H) 



(48) 



(49) 



(50) 
I 

r7i(^) — which, in turn, implies that, due to Eq. (|50p . 
we must have also {m*^^''^} = {0}. A similar argument 
for j'^^ < cannot however be repeated if some of the 
short-range couplings Jq'''^^ are negative. In such a case 
in fact, below the critical temperature Taf;0 - if any - 
of a possible antiferromagnetic phase transition of the 
pure model, the pure magnetizations mg^({/?Jg^''''^''}; 0) 
start to be non zero and to have alternated directions 
in some ordered way to give rise to a pure antiferromag- 
netism so that, from Eqs. and ([50]) . one could have 
in principle m^^^ = but {m^^''^} 7^ {0}. On the other 
hand, at sufficiently low temperatures the SG solution 
(whose effective short- and long-range couplings are all 
non negative) will become the leading solution. In fact, 
as an argument based on frustration suggests, even if we 
are not able to give here the general proof, we expect 
that the pure antiferromagnetism of the pure model (to 
which would correspond a zero order parameter m^^^) 
is never able to win against the spin glass solution. In 
other words, as soon as c 7^ (and then J^^' ^ 0), in 

the homogeneous case, for Jq > there is no way to 
have any kind of antiferromagnetism and, more in gen- 
eral, even if Jg^'^' < 0, antiferromagnetism - if any - is 
expected to be very weak and to be dumped by the spin 
glass phases (note however that for c exactly zero a reg- 

ular antiferromagnetism may set in if Jq < 0). This 
result is quite natural and, for n = 2, in two dimensions, 
has been numerically confirmed in [40] with the choice 

J(M) ^ J(2,2) ^ ^(1,2) ^ ^(1.1) ^ j(2,2) ^ ^(1,2) ^ 

[59]. We point out that Eqs. (gSll-linni) hold for any 
choice of the parameters. In particular, they hold also 
for n = N which amounts formally to a single commu- 



10 



nity (the result reported in the Appendix of the Ref. [20j 
referred to this choice). 

In conclusion, the homogeneous case does not have an- 
tiferromagnetism: to have antiferromagnetism in small- 
world system, it is not enough to have more communities 
but it is necessary that be present some differentiation 
among the distributions of the couplings or some asym- 
metry, either in the size, in the in- and out-couplings, 
or in the external fields. Without any differentiation or 
asymmetry the whole collection of the communities can 
stay only in the same ferromagnetic or spin glass phase 
without any long-range heterogeneity. For example, a 
typical minimal condition to have some antiferromag- 
netism consists in taking, for any I, jC^') = and, for 
any couple {l,k), with I ^ k, all the distributed 
according to a distribution dpS^''^^ having a negative av- 
erage. We will analyze this case, the symmetric case, in 
detail in the next paragraph. 

2. The symmetric case - mutual antiferromagnetism 

The simplest non trivial case to see antiferromagnetism 
consists in choosing the parameters in such a way that we 
have the same short-range coupling as well as the same 
effective long-range coupling inside any community, and 
another same effective long-range coupling between any 
two different communities. This requires that, for any 
c(i,0 = ^(1,1)^ jW ^ j^(i,0 ^ dp}^^'^\ and, for any 
couple {l,k) with / ^ fc, c(''''') = c(i^2)^ jim ^ 

= d^l^^''^\ with ^ Hence, for E =F 

or E =SG, we are left with the only three effective cou- 
plings: /3J^^''''^ = p/p, /3J(^'''') = /3j(^'i'i) and, for 
I ^ k, /Sjf^-''*^) = /3j(^'i^2) ^ Note that the 

condition c*-''*^-* = c^^'^\ for I k, requires the equali- 
ties of the relative sizes a*^'^ — 1/n. In this case (the 
symmetric case) the matrix A*^^'''*^^ simplifies in 

= hSi^u -x{l- 5i,k) , (51) 

where 

;,'^|/l_^j(^;M)^„(^jf);0), (52) 

and 

:c'i/(3J^^--'''^Xo{f3JP;0). (53) 

Hence, in the symmetric case the determinant can be 
explicitly calculated as 

detA(^) = {b + xf\b-x{n-l)). (54) 

From Eq. (|54p we see that Eq. for the critical tem- 
perature of a second-order phase transition has two solu- 
tions: X = —b and x = b/{n — 1). Therefore, we have the 
two following possible solutions 

(/3(S)j(S;l,2)_^(S)j(S;l,l)^ 

X xo(/3Fjf' ;0) =-1, (55) 



((n-l)/3f)j(^^1^2)^^(E)j(E;14)^ 

X Xo(/3f^jf^o) =1. (56) 

For E =SG Eq. gives always a solution, whereas 

for E =F a possible solution will come either from 
Eq. ([55)) or from Eq. ([55)1 according to the signs of 
the effective couplings J^^^^'i) and which are 

averages with respect to the given measures d/i*^^'^^ and 
(^^(1.2)^ respectively. If we are sufficiently far from the 
homogeneous case /3J^^'^^ = PJ^^''^\ antiferromagnetism 
can take place at a temperature given by Eq. ()55p . 
We can distinguish in turn the symmetric case in two 
sub-cases. 

Only mutual interaction: l3J^^'^'^^ = 0. If d^i^^'^^ has 
zero average and /^J*^^-^'^) < 0, the solution for /3c^'' 
comes only from Eq. ([55)1 . In this last case it is easy 
to see that antiferromagnetism sets in by observing that 
for the self-consistent system ([M)) - ([^5)) there are for in- 
stance always solutions of the form 

(m(F^i),...,m('^^")) = 

(0,...,0,m(^),0,...,0,-m(^),0,...,0) , (57) 
and all its combinations, where m*-^-* is any solution of 

Note that, due to the parity of the function tuq with 
respect to its second argument, in Eq. (|58p we are 
free to substitute J^^'^^^) ^j^j^ |j(F;1,2)|_ Solutions as 
Eqs. ([57)l - ([55)) are evidently antiferromagnetic and for 
sufficiently high temperatures are leading against the 
SG solution. In Fig. 1 we plot a case with j'^'^^ = 
and — 1.5. Observe that in this case the solution 

f7^(F) ^ is never stable under iteration. Finally note 
that, for Jq < and E =F, the two terms appearing in 
the Ihs of Eqs. ([55)) and ([55)1 are no more monotonic 
functions of /3, so that, for a sufficiently large value of 
c^^'^', /3c^'' will have multiple solutions. Furthermore, by 
observing that all the critical behavior of the system is 
encoded in the single susceptibility Xo{0Jq ;0), we see 
that we can use the same analysis performed in the Ref. 
(20| : when Jq < the non monotonicity reflects also on 
the fact that the P-F transition may be of first-order. 

Mutual and internal interaction: /JJ^^'^-*, /^J*^^'^-* ^ 0. 
Much more interesting is the case in which there are also 
internal long range-couplings. Let us consider for exam- 
ple the case with two communities. The self-consistent 
system ([M)) reduces to 
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(59) 



det(Ay), det(A) 




2 
T 



FIG. 1: (Color on-line) Solution of the self consistent system 
(|24[1 for the CW model in the symmetric case n = 2 with 
J(^'^' = and J<^'^) = 2.5 or -j'^'^' = 2.5. There is only 
one critical temperature located at Tc = 2.5. Note that here 
we plot all the possible solutions. For j'^'^' > 0, m'^'^-' and 
j^(F;2) (continuous lines) are parallel and coincide, whereas for 
J'^'^' < they are anti-parallel. The plot of det(y4) (dashed 
line) represents the stability curve - under iteration - of the 
solution (m*^'^',m*^'^'), Eq. Jiill, and similarly the plot of 
det(^o) represents the stability curve for the trivial solution 



,(F;i) 



,(F;2) 



= 0; in the case of only mutual interactions 
the two coincide: det(A) = det(^o). Clearly, in this example, 
for T < Tc, no solution results stable under iteration. We 
plot also the free energy term L (dotted line) applied, via 
Eq. (13H1), to the non trivial solution (m^^'^^ m''''^>). The free 
energy term L obtained applied instead to the trivial solution 



,(F;i) - 



,(F;2) 



is a constant (for more details about the 
CW model see Sec. VII), L = Lo = — log(2) and is plotted 
only in the region where the trivial solution is the unique (and 
- of course - stable) solution. 



where we have used the fact that in the symmetric case 

/3J(S;2,2) ^ /5J(S;1,1) ajjd /3J(S;2,1) ^ ;3J(S;1,2)^ ^-^^ 

previous case with pj^^'^^ = essentially we had just 
one order parameter given by Eq. ([SS]) . in the present 
case instead such a reduction is not possible. Here there 
are two order parameters which are intrinsically not zero 
due to the presence of the internal coupling /3J'^^^-' and at 
the same time the two order parameters interact through 
the coupling /JJ*^^'^^ whose sign determines whether they 
are parallel or anti-parallel. For n — 2 from Eqs. ([55]) 
and ([TO)) we see that, if /3J^^'^^ > 0, we have two critical 
temperatures if fiJ^^^'^^ is sufficiently bigger than j/Jj'-'^'^-' | 
(and similarly if (3J'''^'^^ < 0), so that more interesting 
phenomena are expected in this case. The general mech- 
anism will result clearer in the next paragraph. 



3. The general case 

Of course making an analysis of the general case is a 
formidable task, however we can get important insights 
by looking first at the simplest CW model. In the CW 
model we have two great simplifications: since there is no 
short-range coupling we have xq = 1, furthermore, since 
in the CW model the connectivities become infinite in the 
thermodynamic limit, the effective couplings be- 
come linear in (3 (see later for details) . As a consequence, 
for the CW model in the symmetric case Eqs. ([55)) and 
([56)1 are linear in jS and may have at most one solution 
each. However, as soon as we are not in the symmetric 
case, the general Eq. determining a critical tempera- 
ture of a second-order phase transition is no longer linear 
and can have many solutions, i.e., when we are not in the 
symmetric the degeneracy featuring Eq. (j46p disappears 
and we may have a number of multicritical points 0(n) 
where one or more order parameters are non analytic. As 
in the case of a single community, n = I, the existence of 
multicritical points gives us a clue about the fact that the 
self-consistent equations admit more stable solutions. In 
Fig. 2 we plot a case with n = 2. Note however that in 
the case n — 1 the necessary condition for the existence 
of multicritical points was to have a short-range coupling 
negative, while now we do not require this condition, the 
mechanism is indeed completely different and based on 
the fact that there is some differentiation among the cou- 
plings. In [2^ was shown that, for sufficiently large J's, 
the CW model (see later Sec. V) with n = 2 exhibits 
a first-order phase transition tuned by the relative sizes 
of the two communities. In our approach this fact is 
clear since the effective couplings given by Eqs. 

(PS)) and depend on the connectivities c^'''^-' which 

in turn depend on the relative sizes a^'^ through Eqs. 
([7|); as soon as the relative sizes are not equal the con- 
nectivities c''''^-' and then the effective couplings 
are no more symmetric so that more stable solutions may 
exist, and, by varying the parameters and keeping fixed 
the temperature, we pass from one solution, say {m*-^'')}, 
to the other, say {m (^'')}, performing finite jumps, i.e., 
first-order phase transitions in the space of the free pa- 
rameters, with probability 1. 

If we consider now a bit more complicated model as 
the VB model, we still have xo = 1 since there is no 
short-range coupling, but now the connectivities are fi- 
nite so that the effective couplings are no more linear in 
f3. However, in general, for n not small, hardly the sym- 
metric case with only positive couplings will give multi- 
critical points through Eqs. (|55|) and (|56p (this can be 



12 




FIG. 2: (Color online) Solution of the self consistent sys- 
tem (|24l) for the CW model in the symmetric case n = 2 
with J'l'i) = 2 and J^^'^^ = 2.5, or J*^'^' = -2.5. Note 
that here we plot all the possible solutions. For J^^'^^ > 0, 
m'^'^' and m^^'^^ (stars) are parallel, whereas for j'^'^' < 
they are anti-parallel. The several branches of det(y4) (cir- 
cles) represent the stability - under iteration - of the several 
non trivial solutions (m'^''^', m'^'^'), Eq. (|44|l . and similarly 
the plot of det(ylo) (dashed line) represents the stability for 
the trivial solution m'^'^' = m'^'^' = 0. We plot also the 
several branch's of the free energy term L (squares) applied, 
via Eq. (|38|) . to the several solutions. Here Eqs. (|55[) and 
(|56|) give two instability points at the temperatures Td — 2.5 
and Tc2 ~ 1.5. In the thermodynamic limit, only Td cor- 
responds to a true critical temperature, whereas the other 
corresponds to a metastable solution. Furthermore we see 
another metastable solution at Tcs = 1.18 featured as two bro- 
ken symmetries where do not transit around 
0, but around the values ±0.67. 



understood considering large but finite connectivities); 
to have multicritical points, and, in the space of the pa- 
rameters, possible first-order phase transitions, it will be 
necessary to be far from the symmetric case vifith some 
differentiation among the effective couplings. Finally, we 
expect that also in the case of positive short-range cou- 
plings, this scenario basically holds as well. However, 
when some of the short-range couplings are negative, the 
scenario of course changes completely and, as we already 
know from the case n = 1, we may have multicritical 
points and first-order phase transitions also with respect 
to the temperature and even in the symmetric case, i.e., 
without the necessity to have some differentiation among 
the effective couplings. 



FIG. 3: (Color online) Solution of the self consistent system 
(|24p for the CW model in the symmetric case n = 3 with 
J(^'^' = 3 and J*^'^' = 0.5. Note that here we plot all the pos- 
sible solutions. We plot also the several branches of the free 
energy term L applied, via Eq. (|38|l . to the several solutions. 
Here Eqs. (|55|) and (|56[) give two instability points at the tem- 
peratures Tci = 4 and Tc2 = 2.5. In the thermodynamic limit, 
only Tci corresponds to a true critical temperature, whereas 
the other corresponds to a metastable solution. Furthermore 
we see another metastable solution at T^s = 1.32 featured as 
two broken symmetries where {m^^''^\m^^''^\m^^'^^) do not 
transit around 0, but around the values ±0.75. 




T 



FIG. 4; (Color online) Solution of the self consistent system 
(|24p for the CW model in the symmetric case n = 3 with 
j(i'i) = 3 and j'^'^' = -0.5. Note that here we plot all the 
possible solutions. We plot also the several branches of the 
free energy term L applied, via Eq. (|38p . to the several solu- 
tions. Here Eqs. (|55|l and (|56|) give two instability points at 
the temperatures Td — 3.5 and Tc2 = 2. In the thermody- 
namic limit, only Td corresponds to a true critical tempera- 
ture, whereas the other corresponds to a metastable solution. 
We see further metastable solutions at Tc3 = 1.6. with mul- 
tiple broken symmetries where (m'^'^', m'^''^-' , m''''^^) do not 
transit around 0, but around the values ±0.75 and ±0.80. 



Recall that, in general, only one solution of the self- 
consistent equations is leading in the thermodynamic 
limit and, furthermore, a phase transition itself may be 
not leading in this limit, however the stable not leading 
solutions may play an important role when n is high (see 
next paragraph). 



4-. Behavior for large n 

As it was already evident from the previous para- 
graphs, if there is some differentiation among the com- 
munities, as n increases the number of solutions of the 
self-consistent system grows. In Fig. |3]we report a case 



13 



with n=3. Now, only one of these solutions is leading, 
nevertheless, the other stable not leading solutions as 
metastable states play a more and more important role in 
the limit of large n, especially when some of the commu- 
nities interact through negative couplings. In Fig. |4]we 
report a case with n=3 and negative intcr-couplings. In- 
deed, coming back to the symmetric case, from Eqs. (j55p 
and (j56p we see that when the number of communities 
is large, n:s> 1, and the communities are connected, the 
highest critical temperature comes only from Eq. (j56p 
and is the solution of the following equation 

/3f)j(^^^-^)xo(/3f)jf' ;0)^i. (60) 

Recalling the definition of J^^'^'^) we see that the tran- 
sition described by Eq. ([50]) will be cither P-F or P-SG. 
In particular, if J^^'^-^) < the leading transition will be 
only P-SG. 

In more realistic situations, the system will be far from 
the symmetric case. Typically, different couples of com- 
munities will be coupled by different couplings of arbi- 
trary amplitudes and signs, implying therefore frustra- 
tion. As a consequence, in such a disordered structure 
the expected leading transitions will be P-SG. On the 
other hand such a claim results immediately clear to the 
reader familiar with spin-glass theory. In fact, if we look 
at our self-consistent equations (or ([M]) ! for ex- 

ample considering the simplest CW case, apart from the 
fact that in these equations there is not the Onsager's re- 
action term_pi|, they are formally identical to the TAP 
equations [24I (recall that is the field seen by l-th 

community due to the self-magnetization m*^^''^ and to 
the others n — 1 magnetizations). Yet, due to our gen- 
eral mapping which establishes a strong universality of all 
the Poisson small-world models, the general structure of 
these equations roughly speaking is still of the TAP kind 
- but without the Onsager's term - even when there are 
short-range couplings. Therefore, the typical multi- valley 
landscape scenario representing the existence of infinitely 
many metastable states (whose number grows exponen- 
tially with n), possibly also separated by infinitely high 
free energy barriers, is expected in the limit of large n 
with negative long range couplings We recall 

that at low temperatures, where the glassy scenario has 
been exactly confirmed in the SK case, the Onsager's 
term disappears [25j . 

5. Attaching good to bad communities 

When in a given community the J's are almost absent 
and the Jo's are negative, or either when the J's are neg- 
ative (at least in average), as we have already learned, 
there is no way for such a bad community to have any 
long-range order, and the only possible state, at low tem- 
perature, inside this bad community, kept isolated, is the 
glassy state (provided that its own connectivity be suffi- 
ciently high). An interesting issue is then to understand 
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FIG. 5: (Color online) Solutions of the self consistent sys- 
tem p4)) for the VB model n = 2 with couplings J*^'^' = 1, 
j(2,2) ^ j(i,2) ^ j(i.2) ^ connectivities 

c<^'^> = 2, c<^'^> = 2, and c'^'^^ = (empty squares for m'^'^> 
and continuous line for m^^''^^) or c'^'^' — 1 (stars for m^^'^^ 
and circles for m'^''^'). We plot also the free energy terms L 
(rhombus and filled squares for the two cases). 



what happens if we connect the bad community with a 
good community (i.e., having positive interactions and 
then some long-range order) through a certain number 
(proportional to some added connectivity c(l, 2)) of ran- 
dom couplings J^^"^^ . The perhaps surprising answer is 
that, not only the bad community gains an order, but 
also the already good community improves its order. We 
point out that this result is not immediately so obvious a 
priori; the fact that the number of interactions per spin 
has been increased by c(l,2) cannot be used to explain 
this effect that takes place for both positive or negative 
random couplings J^^'^^. However, a simple argument 
based on the high temperature expansion shows actually 
that this is the case: increasing the average connectivity 
always improve the order. In Fig. 5 we report an ex- 
ample for the VB model and compare the two situations 
with and without attaching the two communities. 



C. Level of accuracy of the method 

As anticipated in the introduction, the level of accu- 
racy of this effective field theory is the same as that dis- 
cussed in the Ref. [13]. More precisely, Eqs. (|24ll40p are 
exact in the P region, i.e., the region where any of the 
2n order parameters is zero; whereas in the other regions 
provide an effective approximation whose level of accu- 
racy depends on the details of the model. In particular, 
in the absence of frustration the method becomes exact 
at any temperature in two important limits: in the limit 
— > 0+, l^k = 1, . . . , n, in the case of second-order 
phase transitions, due to a simple continuity argument; 
and in the limit S^-^^ — > 00, l,k = 1, . . . , n, due to the 
fact that in this case the system becomes a suitable fully 
connected model exactly described by the self-consistent 
equations (of course, when c^'''^-' 00, to have a 
finite critical temperature one has to renormalize the av- 
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erage of the shortcuts couplings by c*^''*^^) 



small-world model. By using our effective field theory, 
both these models have been already studied in the Ref. 
[20I I in their n — 1 version. Within the VB models, we 
will consider in particular the limit in which all connec- 
tivities go to infinity, obtaining then the generalized CW 
and the generalized SK models. The CW case model can 
be extrapolated also from the SK model as a particular 
(actually the simplest) case. 



IV. EXAMPLES 

In this section we consider some applications for which 
the method can be fully applied analytically: the gen- 
eralized VB model and the generalized one-dimensional 

I 

A. Generalized Viana Bray models and the generalized Curie- Weiss and Sherrington-Kirkpatrick limits 

Among all the possible cases of the models introduced in Sec. II, the simplest family of models is the one with 

(Ik) 

no short-range couplings: Jq =0, for any I, k, which, can be seen as a generalization of the Viana-Bray model 
to n > 1 communities. When there is no short-range coupling the pure magnetizations and the corresponding free 
energy densities of each community read as 



,W (0;/3/i«) =tanh(/3/i«) 



(61) 



(0;/3/i(')) = - log 2 cosh (/3/i(') 



so that the system (IM1) - (|25I) becomes 



=tanh(H(^^')-f , 



(62) 



(63) 



k 

and for the Landau free energy density one has 



S;i,/c)^(E;/c) 



,(S;n; 



log 



2 cosh 



E 



(64) 



(65) 



where the effective couplings /JJ^^-''*^^ are given by Eqs. ((^ and (P7)) . In particular, more exphcitly, for the measure 
nil we have 



m 



tanh j^tanh'- S'^'^m^''-''^'^ + ph^' 



(66) 



where =1 or 2 for E —F or SG, respectively; whereas for the measure ([22)1 one has 

m(F^')=tanh (/3;i«) , 



and 



,(SG;/) 



tanh [ ^tanh^ (/j/''^')) c^'-'^^mfs^^'^) ) , 



(67) 



(68) 



so that in the case of the measure ([^^ only P-SG like phase transitions are possible. In the case of the measure 
(I^Tjl from Eq. ([5^ we see that if all the couplings jC'*^) are non negative, there are both P-F and P-SG like phase 
transitions, but only the former are leading, due to their higher critical temperature. However, if some of the couplings 
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Jim 

is negative, in general there can be P-F like phase transitions with competitions between ferromagnetism and 
antiferromagnetism and, furthermore, for some range of the parameters there can be also a competition with a P-SG 
like phase transition that in turn gives rise to n stable spin glass like order parameters m'^*^''' . 

The inverse critical temperature (3c of any possible second-order phase transition can be obtained by developing 
the self-consistent system (|63 l) - ([64)) for small m^^^''^ and /i*^'^ = 0. As we have seen in Sec. IIIB, this amounts to find 
the solutions of the equation dct(yl'^^''''''^) = which in the present case becomes 

where we have used Xo''^(0;/?/i('^) = 1 -tanh2(/3/i(')). The non linear equation det A*^^^ ~ provides the exact critical 
temperature of any second-order phase transition of this generalized Viana-Bray model. For example, for n = 2 this 
equation becomes: 

(^l _ /3J(S;1,1)^ (^l _ ^J(S;2.2)^ _ ^^(S;1.2)^^(E;2,l) ^ Q, (70) 

which, for the measure (HH), amounts to 

1 - (c(i'i) tanh'- (/3j(i'i)) + c(2'2) tanh'- (^PJ^^-^^)) + c^^^^^c^^'^^ tanh'- (/^J^^^)) tanh'- (/3j(2.2)^ 

_ (c(i'2) tanh'- (/3 J(i^2)) ) ' = 0, (71) 



where we have used a a^^\ a^^-* = 1 — a and Eq. ([7]). As we have seen in Sec. IIIB, the symmetric case can be 
explicitly worked out also for n generic. From Eq. (I55p and (j56p we have 

^(S)^(S;l,2)_^(S)^(S;14)^_l^ (72) 

and 



1. The CW and the SK limits 

Let us now consider the Curie- Weiss limit with S=F. Given the set of the relative sizes {«'■'■'}, we can recover the 
Curie- Weiss limit by choosing the connectivities c^'''^^ to be equal to their maximum value which, according to Eq. 
jni), is given by 

^c^e^^iV. (74) 

With this choice the probabilities become 

SO that, by choosing the measure ([2T)l with the J^^^^^ renormahzed by 



(i,k) I hj TV 



the CW limit is recovered (of course anything can be rephrased in terms of limits by simply substituting the Ihs 
of Eqs. d7^ - ([75)l the equalities with arrows-limits for N oo). By using Eqs. ([71| - (|75|) for large N , the system 
(l63| - (|64p and the Landau free energy (|65|) . for S =F, become 

m(F^') = tanh (i/^^;') + ^/,(0^ ^ (77) 



(78) 

k 
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E 

l^k 



^(0^(S;0^j(i,fc)^(fc)^(E;fc) 



log 



2 cosh 



(79) 



which generahzes the result found in [23*1 for n = 2 to general n. Notice that, as we explain in Sec. IIIC, Eqs. (I77p - d751) 
are exact at any temperature. 

Analogously, if we assume again ((74)) and choose the measure (|23p. the SK limit is recovered, and for large N the 
system (|63I) - ([M)) and the Landau free energy become 



m(^^') =tanh + /J/i^')) , 



(80) 



;,fe)^(S;fe) 



(81) 



,(") 



E 

Ijtk 



^(0^(0/3j(S;i.fc)^(fc) 



log 



2 cosh 



(82) 



where for large N the effective couplings are given by (according to the measure ([23]) jC^'^) and J^'^*^) are respectively 
the average and the variance of the couplings) 



(83) 



and 



,fc) 



(84) 



Eqs. ([80l) - (l84|) generalize the result found in [s^ and [3§], valid for only a uniform mutual coupling, to general mutual 
couplings as well as internal couplings. Notice that, as explained in Sec. IIIC, in unfrustrated systems, i.e., for 
^ J('.'=), Eqs. (I5D|)-(IH11) are exact at any temperature. 



B. One-dimensional small- world model for n communities 

In the Ref. [20| we have studied in detail the one-dimensional small- world model for n = 1 emphasizing the existence 
of first-order phase transitions for negative short-range couplings. Here we generalize this result to n communities. 
For the free energy, the magnetization and the susceptibility of the pure model of the Z-th community we have 



(/3J<i", log je^-'o" cosh(/3/iW)+ [e^'^-^'' sinh2(/3/i«) + e'^'^^o 



(85) 



'^■^o"sinh(/?/i(')) 



6^/34 'sinh2(/3/i(0) + e- 



(86) 



-/3J, 



COS 



;h(/3/i«) 



e2/34 sinh2(/3/i(0) + e-2/3Jr 



(87) 
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Therefore, the self-consistent system ([24)) - ([25|) for the n communities becomes 



e^PJo sinh2(/3i/(S;0 + 



',fe)j„(S;fe)_ 



(89) 



For the symmetric case, from Eqs. (|55p and (|56p we obtain that the n communities undergo a second order transition 
at a critical temperature given either by 



(^f)j(S;l,2)_^(S)^(S;14)^g2/3p)j<- 



= -1, 



or by 



where we have used, from Eq. ([57)1 . Xo(/3<^o; 0) = exp(2/3Jo)- 



(90) 



(91) 



r 



V. APPLICATION TO PERCOLATION 

A. An effective percolation theory 

The key point of our approach is a mapping that maps 
the original random model onto a non random one. In 
turn this mapping is based on the so called high temper- 
ature expansion of the free energy which, in a suitable 
region of the phase diagram that we call P, converges. 
The boundary of the P region is established by the criti- 
cal condition ([JS]) . Within a physical picture, in Sec. IIIB 
we were mainly concerned with the critical temperature. 
However, it should be clear that the criticality condition 
can be expressed in terms of any of the parameters enter- 
ing Eq. (j46p . In particular, for E =F and non negative 

couplings > and Jq'''^ > 0, it is of remarkable 

interest to study the criticality condition in the limit of 
zero temperature as well as the behavior of the magne- 
tizations to'^''^ near this boundary. Recalling the defini- 



nient to define also Fq 
and exploiting 
see that in the limit (3 
amounts to 





— 1 f 



tion of the set of bonds Tq' and Fq (we find it conve- 





and Fo "^^^ iJv m 









c'^^'^\ for /3 oo, it is easy to 
oo the criticality condition (l46l) 



det 



(1 - £o • c) = 0, {c^-'^-) > O} 



(92) 



where c is the matrix of the added connectivities c^'''^\ 
and the n x n matrix £o = £o{Tq) is given by 



(Ll) 




hm x'^^^Up4^;0) 

p—^-\-oo \ / 



(93) 



if J 



(i.k) 



Q — for any I ^ k, whereas in the general case 



cil.k) _ 
"^0 ^ 



In the above equations it is understood that we are 
considering only graphs Fq such that the pure model has 
no finite critical temperature, i.e., it is only (3co = oo. 
In fact, if this is not the case, as occurs for instance if 
Fq is the do dimensional lattice with do > 2, the P re- 
gion is shrunk to the single trivial point c*^'''"'^ = and 
we can take effectively fp'''"'' = +oo (this issue will be- 
come clearer soon, see also Appendix B). More precisely, 
if Pco < cxD or even if (3co = 0, as occurs in scale free net- 
works with a power law exponent 7 < 3 [4l| . one should 
use Eqs. (IMD and ([MD keeping N finite. 

A solution {cc'''^} of Eq. ([^^ represents the exact 
critical values (or percolation threshold) of the set of the 
connectivities over which a giant connected component 
exists. Note that Eq. ([5^ in general is a non linear equa- 
tion in the unknown connectivities {c{l,k)}. There- 
fore, in general, for n > 2, there are infinite solutions as 
cxd" . This degeneracy of Eq. (|92p reflects the fact that 
given n communities, we can realize a connected clus- 
ter by placing the bonds in many ways, as e.g., either 
over a single community, or between 2 or more commu- 
nities. However, this high degeneracy can be partially 
removed, and Eq. (|92p simplified, when there are special 
symmetries among the connectivities. In particular, the 
symmetric case (Jq'''^ = for Z 7^ fc, c^'''-' = c^^'^' for any 
I and c'^''*'') — c*^^'^^ for any I ^ k) constitutes a simplified 
situation in which the determinant in Eq. (j92p can be 
explicitly calculated as in (|54p . In the symmetric case, 
with the further simplification Jq'''-* = Jq, Eq. ([5^ gives 
the following solution splitted into two branches 



.(1.2) 



.(1,1) 



lim xo (/J-'^oiO) = -1, 



(95) 
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and 

((n-l)4i'2)^^(i4)A xo(/3Jo;0) = l. (96) 

Notice that the solution with Cc''^^ — Cc'^^ = may 
occur only for a divergent susceptibility. In particular, 
when there are no short-range connections, i.e. Jq = 0, 
we have Xo iPJo = 0; 0) = 1 so that Eqs. ^ and ^ 
give the surfaces 

c^^)=c^i)-l, 4i'i)>l (97) 

and, for n > 2 

41.2) ^l^i^^ ,(1,1) (98) 
n — 1 

where we have taken into account that the connectivities 
are defined non negative. 

Similarly, one can study the relative size {s'''} of the 
giant connected component by studying, for Y. = F and 
for non negative short-range couplings, the self-consistent 
system ([M)) - (l^5|) in the limit (3 — > -l-oo, where, again, we 
exploit /Jj'^''^*^) — !■ c'^'''^-', for /? — > cx). In the case of 
j^'.fc) = for ^ 7^ /c, we get 




whereas in the general case, from Eq. (|39p we get 




Note that in the above equations c^^'^^-'s'-'^'' represents a 
fraction of the connectivity c^'-'''\ being < s^'^^ < 1. 
Note also that, by virtue of some non zero short-range 
couplings Jg'''''' with I ^ k, and Jq'''''' with I ^ h and h ^ 
k, the relative sizes of the giant connected component 
of the two communities I and h, Sg ^ and s'^^ (the pure 
model) , influence each other also if there is no short-cut 

among the two communities, Jq'^'^ = . 

When we are far from the symmetric case, the self- 
consistent systems or (|101l) in general may admit 
many stable solutions, i.e., solutions {s*^'-'} such that the 
Ihs of Eq. ([5^ is positive. The relative probabilities 
among these solutions can be calculated as exp(— L) from 
the expressions (l36l) or ((40|) for the Landau free energy 

(I k) 

density in the limit /? +00. In the case of Jg — 
for I k, up to a constant term, we get 



L 



(.«,...,.(")) =^a(')4') (j^s'^hc^A+Y: 

I \ k J l.k 



Q,(i)c('.''-)s(05(fe) 



(103) 



where 



4" (^^c('''=)sWj =^ hm 



/3-++00 



\ / iV — *o 



1 



log [cosh (/? Jg,_^) 



(104) 



Notice that in defining Lg^ in Eq. (|104p we have subtracted the trivial and divergent terms log cosh Jg'|. ^.^^ 
which, being constants, do not modify the relative probabilities. Similarly, in the general case we have 



('" 



E 

l,k 



^(l)cil,k)^(l)^ik) 



(105) 
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where, 



def 



lim 



(106) 



(»j)eu,,fcr<;'''-' 



Of course, among all the stable solutions of the self- 
consistent system ((99|) or (llOip the leading solution will 
be given by looking at the absolute minimum of L. It is 
interesting to observe that the term —Lq, as a function 
of a generic c, is nothing else than the logarithm of a 
degenerate partition function. We report its expression 
in Appendix A. 

The self-consistent systems (|M| or (|101l) are exact in 
the P region, that is for all values of the vector {c^'''^^} 

below the leading {i.e., minimal) critical surface {cc''^''}, 
however, again, the limits {cS'-''^') 0+} and {c'^''*^^ — > oo} 

will be exact independently of the critical surface {cc'''^^'}. 
Under these limitations, our result for percolation con- 
stitutes a generalization to generic n of the approach de- 
veloped in [i^, which was built for n = 1. 

We end this paragraph by giving the meaning of the 
above expressions directly in terms of graph theory. Con- 
cerning Sq and s*^'-* they clearly represent the fraction of 
the sites belonging to the giant connected component (if 
any) in the l-th community. More precisely, in the most 
general case we have 



the matrix S^''''^ we have (see Appendix B for details) 



(1,1) _ 



lim y 



(108) 



where Mf^ is defined as the number of vertices belong- 
ing to the /-th community (including i itself) which are 

reachable from the site i e £q by at least one path of 
connected vertices. We recover hence immediately that, 
e.g., for the case of no short-range coupling Jq = 0, 

we have Mf' = 1 and then Hni/j^oo Xo {^^t^'i^ = 

1. Similarly for the case in which (4'\rJ,'^) is the 
one dimensional chain we have Mi = N and then 

lim/3^oo Xo {pJo'';^^ = Finally, for I ^ k, hy 

defining M'^'''^\ with i belonging to the l-ih community, 
as the number of vertices belonging to the fc-th commu- 
nity reachable by at least one chain of bonds from the 
vertex i, we have the following expression analogous to 
Eq. (UnHl) 



4') ({0}) = hm 



(i) n. 



(0 



(107) 



,(/,fc) 



= lim 

N 



E 



Ml 



(Lk) 



(109) 



where rt^'"' — 0, 1 if respectively the vertex i £ Cq 
belongs or not to a connected cluster with the prop- 
erty to be giant (if any) and having bonds belonging 



(0 



to the given initial set of bonds U/'^fc/F, 



(i\k') 



Similarly, 



Sq'' (^|c^' '^^D ^^'^ '^^'^ have analogous expressions as 
Eq. p07p and represent the fraction of sites of the Z-th 
community belonging to a connected component with the 
property to be giant (if any) and having bonds belonging 

to the union of the initial set of bonds U/'.^/Fg ''^ ^ and the 
other bonds randomly spread according to the set of the 

given added connectivities Note that, by def- 

inition, the only difference between Sg' (^l^*^' ■'^ and 

s^') is that in the latter case we have to average over the 
different realizations of the graph with the distribution 
(PO)) . while for the former, as for the case of thermody- 
namics, only the average values of the connectivities are 
taken into account. Concerning instead the meaning of 



Note that now it can be also J\fl^'^^ = 0, while, by def- 
inition A/'/''''' > 1. Furthermore it holds the following 
balance 



(110) 



By using the obvious generalization of Eqs. (jlOSp and 

P09p . we can define a quantity similar to Eq'^\ £^''''^\ 
to include the presence of added bonds randomly spread 
according to the measure (fT8|) with average connectivities 
{c*-'"'"'-'}, and from Eq. (|42ll in the zero temperature limit 
we get (in matrix form): 



£ = {l-£o 



£o- 



(111) 



Eq. (jllip tells us how £ changes as we vary the {c*^'''^-'}, 
being an exact equation as the {c'-'''^-'} belong to the P 
region. 
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B. Percolation threshold vs fractal dimension 

Let us come back, for the moment being, to the case 
n = 1 and let us consider the simplest model: the VB 
model (see Sec. IV). In this case Eq. (|92l) gives imme- 
diately the critical value Cc = 1, which is the very long 
known value of the percolation threshold for the Pois- 
sonian graph [3]. On the other hand, if we have a do- 
dimensional underlying pure graph (£o,ro) and do > 1, 
whatever (Co^To) may be complicated, we always have 
So = OiN) or, equivalently, in the limit f3 —>■ +oo for the 
susceptibility of the pure system we have xo — > +oo, so 
that for the critical value we get always the obvious result 
Cc = 0. To have a critical value Cc strictly in the range 
(0, 1) it is necessary that the underlying graph {Co, To) 
has a dimension lower than 1: do < 1. For example 
one can consider the case in which the graph {Co, To) is 
made up of finite units as dimers, triangles, etc.. For in- 
stance, in the Ref. [l^l we have studied the case of dimers 
for which we have xo{PJo]0) = (exp(/3Jo))/ cosh(/3Jo)- 
Therefore in the limit /3 — > -|-oo we get xo — * 2 or, equiv- 
alently, £o — 2, which inserted in Eq. ([^^ gives the 
result Cc — 1/2. This result is still trivial because in this 
example we have do = 0. However, there is no limitation 
in the choice of the graph (£o,ro); all the theory holds 
for any arbitrary graph {Co, To) which in particular can 
be some quenched graph obtained by removing randomly 
a sufficient number of bonds from another initial regular 
graph so that the final graph {Co, To) will have a non 
trivial value of So corresponding to a fractal dimension 
do e (0, 1) d^. Similarly, as already stressed in Sec. II 

for generic n, for any I and any k, the symbol Jq'''^ is 
actually a short notation to indicate all the short-range 
couplings connecting the l-th and the fc-th community: 

_ |j^i,fc)^^|^ ■ ^ ^{i) ^ ^ ^ C''^''; so that the graphs 

^ p(i,fc)-j| completely arbitrary with a non triv- 
ial percolation threshold surface coming from Eq. ([5^ . 
Typically, scale free networks, as the Internet, own frac- 
tal properties fZoj, however in this case dg — > oo in the 
thermodynamic limit, so that the percolation threshold 
in these networks becomes zero. 



C. When two given communities do communicate 

The answer to the fundamental question "when and 
how much two given communities communicate" is en- 
coded in Xo '"'' and x^'''^'' which at T = means 
fg''*^-* and S^-^\ respectively. Given the arbitrary pure 
graph {Co, To), and some community structure assign- 
ment which splits the set of bonds To in n{n — l)/2 sets, 

(I k) 

To = Uj^fcTQ ' , at r = 0, in the pure graph the communi- 
ties I and k communicate if and only if Sq''^'^ ^ 0. We can 
understand the communication process as follows. If sud- 
denly, at a given initial time, appears an external mag- 
netic field h'^''\ which acts uniformly only on the spins 



of the fc-th community, these spins are forced to change 
and, as a consequence, all the spins of the other com- 
munities will have to suitably change in order to reach 
the new equilibrium state. At finite temperature the new 
equilibrium state will be reached after a relaxation time 
T which grows with the size of the system. However in 
the limit T ~> there is no thermal dissipation and the 
spin changes take place instantaneously. Therefore, if the 
external field phS'^'' changes with time with a constant ve- 
locity, say w^'^^ from the relation ^m*^'^ ~ x^^'^^ 5{(3h''^^) 
extrapolated at T = 0, we see that the characteristic time 
ig '^"^ to transmit a unit of information from the commu- 
nity k to the community I in the pure model will grow 
as 

v^^h^i^'''^ = {s^^'''^y\ (112) 

Similarly, in the random model having a matrix of added 
connectivities c, the communities I and k communicate 
with a characteristic time given by 

From Eq. piip we see that in the pure model, if 
_ ^j^g communities / and k cannot commu- 
nicate (tg oo), but for any arbitrary small S-^'^^ > 
they communicate and the characteristic time decays 
with c approximately as (recall that for any I is always 

> 1) 

Similar relations hold also at finite T provided the ve- 
locity of the signal, w'-'^-', be sufficiently small so that 

T<4''''^ or T < 

In general if, due to the birth of some giant con- 
nected component in the pure model, one has Sq''''' —>■ oo 
in the thermodynamic limit, correspondingly we have 
tg 0, and then also i^'''^-' 0; i.e., the communities 
communicate instantaneously (they percolate). However, 

(I k) . 

in the random model, even if Sq is finite, provided non 
zero, when c approaches the percolation threshold surface 
Cc, given by Eq. ([5^ . then we have t*^'''^-' 0. Of course 
intermediate situations will give rise to finite values of 
tC.fc), jn Eq. (jllip the matrix £o represents an input 
data. In general, it can be sampled efficiently by simple 
simulated annealing procedures by using Eq. (j94p . since 
the problem is mapped to an unfrustrated Ising model 

{p/o'''^ > 0). 

We recall that there is no limitation in the choice of the 
graph {Co, To) and that the statistical mechanical frame- 
work provided through Eqs. (|93l94p and Eqs. piT7)) - plUl) 
is complete and exact. Note in particular that two given 
communities I and k, when immersed in a context of more 
communities, can communicate even if there is no bond 
between them, rg'*^-* = {0}, due to the presence of one 
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(or more) chain of communities other than / and k that 
start from I and arrive to k through a sequence of, say to, 



sets r^o'''\ 



(/™,fc) 



In other words, if we activate all 

(i',k') 



the couplings of the set Tq, {(iJ^ ' > 0}, Eq.dM]) takes 
into account that a message can go through any of the 
different paths of communities. We point out also that, 
in the pure model, having some bonds between the l-th 
and fc-th communities does not ensure that the condition 
5^''''^ > be satisfied. From Eq. (flOQl) we see in fact 

that for having S^''''' > it is necessary that the number 
of paths between the ^-th and the fc-th communities be 
at least of order N. Note also that such a requirement 
does not exclude the possibility that even a single bond 
between the two communities be enough, provided this 
bond has a very high betweenness. It should be then 
clear that an analysis of the given graph {Co,Tq) based 
only on simple algorithms making use of the adjacency 
matrix, and that are therefore local, can never capture 
global features as the ones we have elucidated above and 
that determine the real communication properties of the 
network. 



D. Percolation vs community structure 

The analysis of the previous paragraph suggests also a 
possible criterion to detect community structures. Our 
idea to detect community structures comes from the 
physical picture of percolation. Given an arbitrary graph 
{Cq,To), and an hypothetical number of communities n, 

we look for the partition {Cq = U[Li/;[,'\ Tq = ^It^o'''^) 
such that the resulting community's structure has mini- 
mal communication, i.e., according to the previous para- 
graph, we look for the minimization of the sum of the 
non diagonal matrix elements of the matrix £o. It is 
possible to make more precise this criterion by consider- 
ing the modularity introduced by Newman and Girvan. 
In P, given an arbitrary graph (£o,ro), one introduces 
a "measure" Qi = Qi(ro) - known as modularity - of the 
quality of assignment of vertices into communities. It is 
defined as 



(«f>)' 



(115) 



(I k) 

where: e\ , with / 7^ fc, is the fraction of all bonds 
connecting the two communities I and fc, e^'''' is the frac- 
tion of bonds falling inside the community I, and af^ 

is defined as a^'^ X^fe^i^ ''^ ^^'^ fraction of all bonds 
having one or two ends in the community /. The term 
{cii^)^ in Eq. (jllSp represents the expected fraction of 
bonds falling inside the community I when their ends are 
connected randomly. Thanks to the presence of the term 
(a^^)'^ in Eq. (|115p . Qi gives measure when one con- 
siders the trivial case in which Fq is a single community 
(n = 1), and partitions that maximize Qi correspond 



to best community structures. Nothing however avoids 
us to define another similar measure which takes into ac- 
count not only bonds, but also, for example, paths of two 
consecutive bonds. In general we can define 



E 



{4^ 



(116) 



where now e^^'''^'' for ^ ^ fc is the fraction of all paths of 
length not greater than h connecting the two communi- 
ties I and fc, ejj''-* is the fraction of all paths of length not 
greater than h whose both ends are in the Z-th commu- 



nity, and aj^ = 



JIM 



k '^h 



is the total number of paths of 



length not greater than h having one or both the ends in 
the community I. Again we have that its square repre- 
sents the expected fraction of paths of length not greater 
than h having both ends inside the community I when 
they are connected randomly, and makes the measures 
pi6p non trivial. 

When we optimize Qi with respect to all the possible 
ways of assignment of vertices into communities, we are 
looking for the best case (or the cases) in which there are 
"few" bonds between different communities and "many" 
inside the same community. Similarly, when we optimize 
Qh with respect to all the possible ways of assignment 
of vertices into communities, we are looking for the best 
case (or the cases) in which there are "few" paths of 
length < h whose ends arrive in different communities 
and "many" paths whose ends arrive in the same commu- 
nity. Clearly, the bigger is h, the stricter and demanding 
is our definition of Q^. Consider for example that we are 
looking for an assignment in two communities, n — 2. 
An assignment optimal with respect to Qi will give typi- 
cally many bonds inside each communities and only a few 
between the two. On the other hand, inside for instance 
the community 1 , there may be many paths of length not 
greater than h — 1 converging at a same vertex inside the 
community 1, vertex which in turn is connected by a fur- 
ther bond to the community 2. Therefore, in general, the 
above assignment of 2 communities will not be the best 
assignment with respect to Qh, and in this example Qh 
will be better optimized for just one community, n = 1. 
In general Qh will selected assignments such that between 
any two communities there are either "few" bonds or, if 
there are "many" bonds, such bonds must have a small 
betweenness, and the greater is h, the smaller will be such 
allowed betweenness. More precisely, we see that there 
are basically two regimes: when h <C N/n, N/n being 
the typical size of one community, the probability that a 
path of length not greater than h leaves the community 
from which it starts, say the fc-th one, depends only on 
the local topology near the fc-th community and on its 
boundaries with the other nearest communities, whereas 
when h ^ N/n this probability will be highly affected by 
the value of N/ n and will be very large for small values of 
N/n; i.e. for the case of many communities. Eventually, 
in the thermodynamic limit, for h — > 00, Qh will select 
a community's assignment such that for any two com- 
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munities there is zero betweenness and, in this hmit, the 
above definition of e^'''^^ , up to a constant factor which 
is independent of the community's assignment, coincides 
with Eqs. (|108p and (|109p . In this Hmit, in particular, 
if some percolation takes place, the community's struc- 
ture that maximizes Qh will coincide with the ensemble 
of the finite and infinite (percolating) connected clusters 
that form in the graph. 

We find that our approach for community detection 
has some analogies to the random walks approach devel- 
oped in [l^ . Actually, as stressed in JJj,] , there are many 
different ways to define dynamical processes (with contin- 
uous or discrete time) able to probe the community struc- 
ture of networks having different features. In particular, 
given the adjacency matrix of the given graph, ^ij , we 
can distinguish two family of dynamical processes built 
through the normalized or unnormalized Laplacian op- 
erator. Our approach belongs to the second family so 
that uncontrolled large fluctuations are involved when 
sampling the evolution operator exp(— Ai) at large times 



and the method turns out to be in principle inefhcient. 
However, as explained before, in the limit t — » oo our 
method does not need to sample the operator exp(— At), 
but only to evaluate the susceptibility of the unfrustrated 
Hamiltonian model Hq at zero temperature via simulated 
annealing. As has be en p ointed out in jl^ , the methods 
developed in [Tsll and jl2l| which map the problem of com- 
munity detection to that of finding the ground state of a 
suitable frustrated Potts model, are equivalent to consid- 
ering the modularity built through dynamical processes 
at small but finite t (0(1) in adimcnsional units). It is 
then clear that our proposed method of community detec- 
tion, although be defined through an Hamiltonian model 
too, is completely different from these other Hamiltonian 
methods. As mentioned in the introduction the reason is 
due to the fact that our method is based on the correla- 
tion functions, and not on the energies, and the correla- 
tion functions, even at equilibrium, have a well defined 
relationship with dynamics. 



I 

VI. MAPPING TO A NON RANDOM MODEL 



In the Ref. 20] we have made use of a general mapping: an Ising model with random couplings and defined over a 
random graph is mapped onto a non random Ising model turning out (in that specific case of just one community) an 
Ising model defined over the fully connected graph F j , and having only a constant long-range coupling, (}J^^^ , and a 

constant short-range coupling, (3Jq^^ , suitable tuned by the measures of the graph-disorder and the coupling-disorder 

of the original model via the identities: /3 J^^^ = /? J^^^ and /? Jq^^ = /? Jq^^ . More precisely, in the Ref. [131 we saw 
that the mapping consisted of two steps. In a first step we map the original model onto a random Ising model with no 
more graph-disorder and built over T f. Then, in a second step we map the latter model onto an Ising model with no 

(I k) 

more coupling-disorder. Due to the independence of the random matrix elements j and of the random couplings 
it is not difficult to generalize the mapping to our case of n communities. By defining jf'j'^'' as 

after the first step, the free energy (fT2|) reads as 

- pF =^ J dp (j) log (Zp^^j) , (118) 

where: F/ is the "fully connected graph" obtained as union of all the fully connected graphs for each community I 
and for each couple of communities {I, k) 

r/i/ u,r«u<..r('''=); (119) 

Zyj is the partition function of the random Ising model defined over Tf with the random Hamiltonian 
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and the «7's are distributed according to the measure dV ^ given by 

dv (j) n n '^-^''^ (-^S'O 



n n d^''' (-^^^0 



(121) 



with 



,~(l,k) 



l,k) 
3) 



(l.k) ( j{Lk) 



(hi) 



(122) 



being the couphng- and bond- (Eq. measures of the original model introduced in Sec. 

II, and dfiQ'''\jo)/dJQ the delta distribution around the given short-range coupling Jq'^'K For the second step we 
have to use the general rule of the mapping to map a random Ising model built over a quenched graph to a non 
random Ising model {the related Ising model, whose quantities we label with a suffix /) having suitable couplings [s^ . 
Depending on whether we are looking for the solution with label F or the solution with label SG, the coupling or 
mapping substitutions are given by 



{.,„i.(„j;«)}^|/.^(j;«)t.„h'-(,j;«) 



(123) 



where Zx; = 1 or 2 for S =F or SG, respectively. We recall also that there are no intermediate transformations mixing 
the F and the SG solution: there are only two physical transformations, be F or SG, affecting simultaneously all the 
couplings. After the second step, the free energy of the original problem reads as 



PF^Y. J2 log [cosh +^ ^ \og[cosh (^(34'"^ 



where 4> is the non trivial part of the free energy, whose density (/?, (and similarly any correlation function C) in the 
thermodynamic limit can be calculated through ipj (C/V, the free energy density (the correlation function) of the 
related Ising model having couphngs obeying Eq. (|123p |60 |. 



VII. DERIVATION OF THE SELF-CONSISTENT EQUATIONS 

By using the above result, we are now able to derive Eqs. (|24ll46p . To this aim we have to solve the thermodynamics 
of the following related Ising model 

hj^-j:4"''' e -.-.-E-^r'^ E -^-^ (125) 

- E^^'^ E 

Note that the above couplings (uniform within each appropriate set) Jq^''''^'' and are arbitrary. In fact, the 

mapping requires to solve the thermodynamics of the related Ising model with arbitrary adimensional couplings 
pj{i;i,k) g^j-^j only after to perform the mapping substitutions (|123p . Therefore, as done in the Ref. 
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[20| . we find it convenient - for physical and conventional reasons - to consider not the Hamiltonian (I125P and the 
transformations (jl23p . but the following Hamiltonian and transformations 

Hi = -Y.4'''' E E (126) 

E E ^''^J " E iVaC.'^-) ^ '^''^^ 



E^^'^ E 



tanh /3 




d^J^jtanh- 



is 



?(i,fc) 



(i,fc) de/ J 1, 



(127) 



where we have introduced the coefficient a'-''*^-' , giving the total number of possible bonds between the Z-th and the 
fc-th community, via A^^'-*^) = a^'-''^^N 



^(l,k) de/ J I = k, 



(128) 



where a^'^ has been introduced in Sec. II and is related to the size A^*^'^ of the l-th community via A^^'^ — a^'^A^. 

By using now Eq. in Eqs. (|117p - (|122p . from Eq. (|127p applied for large N, we obtain that, after solving the 
thermodynamics of the related Ising model with Hamiltonian (I126p . the mapping transformations for any I, k read as 



I;l,k) 



dl,k) 



a 



{I;Lk) 



(fe) 

(S;i,fc) 



(129) 
(130) 



where we have made use of Eq. ([8]) and of the definitions (l25l) - ((28)) . It is important to observe, from Eq. (|129p . that, 
unlike the effective couplings [3J'^^''^'^\ the couplings /JJ^^-''*^^ of the related Ising model are symmetric. 
Let us now solve the related Ising model (jl26l) . We have to evaluate the following partition function 



-PH, 



(131) 



Up to terms 0(1) Hj can be rewritten as 



Hj = Ho{{4''''%m;{a,})-Y: 



E 

Kk 



j(I-Lk) 



E ^» 



(!,fc) 





(132) 



where we have made use of the definition of Hq (^{^/q' '^''I; {/i'-'-'}; {ci}^ , the Hamiltonian of the pure model with 
couplings {Jq'''^'} and in the presence of the external fields {/i*-''}, and we have introduced 



{l,k) dej (/) 



' 1 1 r 



(k) 



(133) 
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Eq. (I132[) can be rewritten also as 



j(im 



(134) 



We now proceed analogously to the Ref. [20] by using the Gaussian transformation to transform quadratic terms in 
linear terms coupled to n + n(n — l)/2 auxiliary fields that we shaU indicate with Af(') and M^^^^\ It is convenient 
to introduce the following definitions 



1^ n,{l,k) ■ 



v(0 



(135) 



fc) deJ / 0, if J(^-''^) > 0, 

1, if J('f''''^) < 0, 



and 



I) deJ / 0, if > 0, 

1, if < 0. 



(136) 



(137) 



By using these definitions and Eq. (|134p . after the Gaussian transformations, the partition function Z/ reads as 



Kk 



X exp 



X exp 



Kk 



E 



(138) 



which, by using the definition of Lq'^'^ and Ho {{Jq''^^}; {/i*-''}; {fj}), becomes 



Ji,k) 



{cr,} i Kk 



X exp 



i<fe 



where we have introduced 



^(0 def pjiw);m)M(i) 



ail) ' E ^{Uk) 

k.k^l 

For finite we can exchange the sum over the cTi's with the integral and we get 



Pj{I;l,k)^r{l,k)j^{l,k) 



(0 



I Kk 



(139) 



(140) 



(141) 
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where 



Kk 



2Q.(i,fe) 



+ ({p4'''''\m^'^}) , (142) 

}; ) being the free energy density of the pure model with arbitrary couphngs { Jq'''"''} and in the 

presence of arbitrary external fields {h'^^^}. By performing the saddle point integration and 



(143) 



we arrive at the following system of equations for the auxiliary fields 

f(M)^(/) = «(04')(^{^j(^;''''=')};{/?i7(O})^ (144) 

where we have used | jC.fe) jr^'^/jO^fc) ^ i/r"'"' and similarly |i'-"''" /^^'''^ = l/i''"'". Eqs. (Hm) and IHSl) lead 
immediately to identify the auxiliary fields with two indices, if solution of the saddle point equations, as 

jr(;,fc)^^(;,fc) ^ f{i,i)]\j{i) f{k,k) jYj{k) _ (146) 

If we now use Eqs. (jl46l) and the definitions (|135p inside Eqs. (|140l) we see that the iJ^'^'s calculated at the saddle 
point simplify in 

i/o^v^^'"'"^;:^^'''^/^^^^ (147) 

^ — ^ (y\hk) 
k 

SO that the system p44p is actually a system of n independent equations in the n unknowns M*^'^. We can get rid of 
the imaginary unit by changing the set of variables from M^^^ to i^C^''^) M^'^y Furthermore, if we divide by that 
is if we define 



the system ()144p becomes 

mW= ({/3jf (149) 
where the i?^''''s, as a function of the fields m'-'', have now the form 

^^'^-E ^ Jk, (150) 

A: 

Finally, by performing the mapping transformations (|129p - ()130p . the system of equations (|149p - ()150p gives the system 
([M)) - (|25p or, in its most general form, Eqs. ([55)1 . Similarly, given a saddle point solution, by inserting Eqs. p48p - (|150p 
inside Eq. (|142p we get the free energy density // of the related Ising model as 



(151) 



where Lj is defined through Cj calculated at a given saddle point 

Lj ({mC')}) = Ci ({a/(^p^') ({m('')}) } ; {m(^p^''''=') ({mC')}) }) , (152) 
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where M^^^p^') ({"^^'' j) and Af^^'P^'^'^) ({'"^'' j) 

are the given solution of the saddle point equations, i.e., modulo the 

definitions (fMS]) . they satisfy Eqs. (fT49l) - (fT50l) . Finally, by using the mapping transformations (fT29l) - (fT30l) . Eq. (fT52l) 
provides the Landau free energy term (I38p of the random model, or in its more general form Eq. (|40p . Of course, 
as can be checked directly by deriving /?// (/3/'^-', or more simply L*-^-*), with respect to the external field (3h^^\ the 
saddle point {m'^P} ({m^^'')}), solution of the system (|149p - (|150p ( (l39|l ). are the local magnetizations {at) ((ai)'^), for 

i G {Cq^}, of the related Ising model (of the random model). The non linear system p9p may admit many solutions. 
The unstable solutions which are not local minima of the functional Cj , do not have any physical meaning and should 
be discarded by looking at the Hessian of Ci equipped with the transformations (|129p - p30p and calculated at the 
saddle point. In general we may have more then one stable solution. The saddle point solution that turns out to be 
also the absolute minimum of the functional Cj equipped with the transformations p29p - (|130p corresponds, in the 
thermodynamic limit, to the leading physical solution, the others being metastable states. Notice that, unlike the 
case n = 1, due to the fact that the saddle point solutions live in a n-dimensional section of the original n + n(n — l)/2 
dimensional space, Li turns out to be quite different from Cj and in particular the Hessian of Lj has nothing to share 
with the Hessian of £7. Unfortunately the Hessian of £/, which we recall has to be calculated through the second 
derivatives of of Cj as a function of a generic point {Af^'^j, {Af^'''^^} of the n + n{n — l)/2 dimensional space, has a 
quite complicated form that does not seem to simplify even if calculated at the saddle point. Note however that, given 
all the solutions of the self-consistent system ([M)) - (|25p or Eqs. ([59]) . for any value of (3, we can always understand 
which one is the leading solution: the leading (and of course stable) solution is the one that minimizes 

I 



VIII. CONCLUSIONS 

Motivated by the general issue "how two given com- 
munities influence each other" discussed in the introduc- 
tion, or in other words, "what are the laws regulating the 
meta-network" , we have formulated the problem through 
the analysis of a generic disordered Ising model built up 
over a small- world of communities (the meta-network), 
where short-range couplings as well as long-range cou- 
plings are completely arbitrary and the graph disorder 
is Poissonian. By generalizing the method we presented 
in the Ref. [1^, we have then solved this random model 
in terms of the pure one, where no disorder is present. 
The resulting self-consistent equations are a sort of 
effective TAP equations in which each community con- 
tributes as a meta-spin, as if they were microscopic spins 
immersed in a ferro or glassy material. 

The consequences of such a general result are then an- 
alyzed both at finite and zero temperature (in the latter 
case only for the unfrustrated case) . When the number of 
communities n is not large, besides ferromagnetism, rel- 
ative antiferromagnetism among communities may arise 
if some of the long-range couplings J's have negative av- 
erages. However, if the number of communities is large, 
n 1, the TAP-like structure of the equations leads to 
many metastable states, whose number, in the case in 
which the J's have negative averages, may grow expo- 
nentially fast with n, and a glassy scenario among com- 
munities takes place. In the latter case, the system turns 
out to be highly sensitive to small variations of the set 
of the many free parameters of the model, such as the 
relative sizes of the communities, a^'-* , the short-range or 
the long range couplings, the averages of the added con- 
nectivities c^'''^-', etc... In other words, the free energy 
landscape changes fast by changing the free parameters, 
so that many first-order phase transitions are expected 
when we vary these parameters. In fact, in a tentative in 



modeling societies, between second- and first-order tran- 
sitions, the latter are expected to be largely prevalent, 
consistently with the fact that "unpredictable" behavior 
of human communities seems to be a largely prevalent 
rule. Finally, at zero temperature the general formula 
for the relative susceptibilities (|42)) has provided us the 
answer to the fundamental issue "when two given com- 
munities do communicate" . We find that, unlike the pure 
model, in the random model two communities I and k 
do communicate as soon as c*^'''^'' > 0. However, the 
evaluation of the corresponding characteristic time t*^''*^^ 
depends crucially and in a non trivial way on the sus- 
ceptibilities of the pure model in- and between- the two 
communities via Eqs. (jllip - (jll4p . In particular, when 
the matrix of the added connectivities c*^'''^-' reaches the 
percolation threshold Cc'''^ determined by Eq. ([5^ . the 
communities communicate instantaneously (at T = 0). 

In conclusion, our analysis at finite or zero tempera- 
ture shows explicitly that methods aimed to study the 
communication properties and, more in general, the rela- 
tionships among communities, of a given network, cannot 
rely on a local analysis in which the adjacency matrix is 
used only in simple algorithms and/or correlations are 
not taken into account. Instead, starting from real-data, 
it is possible to define in a not ambiguous way a mini- 
mal model, a disordered Ising model, able to take into 
account all the correlations, short- and long-range like, 
present in the given network, and then to capture, via 
effective TAP equations, the exact relationships among 
the communities. 
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APPENDIX A: PARTITION FUNCTION FOR PERCOLATION 

The term —Lq, as a function of a generic c, is nothing else than the logarithm of a degenerate partition function of 
the l-th community as follows 



4'^ (c) 



1 



log 



(Al) 



for the case of Jq'"'^'' = for / 7^ fc, whereas in the general case one has 



Lq (ci, . . . ,c„) = - lim —log 

N^QO I\ 



{rTi},ieU,£<,'' 



e "^^0 



fc)eu,,;,r<,'''=) 



(A2) 



APPENDIX B: DERIVATION OF EQS. ([T09 |) -([TT0 |) 

From the definition of the susceptibility, at any temperature we have 



(Bl) 



Now, we have to recall that in our small- world models one has always pco < K , where /3c and /3co are the inverse 
critical temperatures of the model with and without the added short-cuts, respectively (the random model and the 
pure model). Therefore if the random model is in the P region, also the pure model will be in its P region. We can 
repeat the same identical argument for any parameter entering in our models. In particular, given (3, if the given 
connectivity are below the critical percolation surface, not only the random model, but also the pure one will be in 
their P region, so that in such a region Eq. (|B1[) becomes 



-{1,1} 
Xo 



(B2) 



Now, due to the fact that in the limit (3 ^ 00 two given spins Ui and Uj are cither infinitely parallel correlated or 
completely uncorrelated if they are respectively connected or not by at least a chain of bonds Jq-sj (supposed here 
only positive if any), from we Eq. (jB2|) we get 



limxrf/34'^0)= lim V ^ 



(B3) 



where A/^*''' is defined as the number of vertices belonging to the ^-th community (including i itself) which are reachable 
from the site i G Cq^ by at least one path of connected verti ces. Similarly we arrive at Eq. (jllOp. 
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